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ABSTRACT 



This statement discusses the impact of Head Start on 
children and their families and the adequacy of Health and Human Services ' 
(HHS) current research plans to provide additional information on Head 



Start's impact. The statement describes the background of the Head Start 
program, summarizes the results of a 1997 review of research on Head Start's 
impact, outlines HHS ' s current initiatives to assess program impact, and 
suggests ways to improve their efforts. The statement indicates that although 
Head Start has provided comprehensive services to millions of low- income 
children and their families, little is known about whether the program has 
achieved its goals. The body of available research is insufficient for use in 
drawing conclusions about the impact of the national program. HHS has three 
impact assessment initiatives: (l) development of performance measures 

focusing on program outcomes; (2) a national longitudinal study of a 
representative sample of Head Start children and their families (Family and 
Child Experiences Survey) ; and (3) a collaborative effort with the National 
Center for Educational Statistics. The statement maintains that it is unclear 
whether these efforts will meaningfully compare the outcomes achieved by Head 
Start children and their families with those achieved by non-Head Start 
children and families. The use of randomized trials applied to Head Start is 
discussed . ( Author/KB) 



ED 420 382 



United States General Accounting Office 



GAO 



Testimony 

Before the Subcommittee on Children and Families, 
Committee on Labor and Human Resources, U.S. Senate, 
and the Subcommittee on Early Childhood, Youth and 
Families, Committee on Education and the Workforce, 
House of Representatives 



For Release on Delivery 
Expected at 9:30 am. 
Thursday, March 26, 1998 



HEAD START 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
- CENTER (ERIC) 

Nf^This document has been reproduced as 
* received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



Research Insufficient to 
Assess Program Impact 



• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 

Statement of Carlotta C. Joyner, Director 

Education and Employment Issues 

Health, Education, and Human Services Division 





JUQ- 





c d i -HEHS-98-126 



2 



Head Start Research Insufficient to Assess 
Program Impact 



Messrs. Chairmen and Members of the Subcommittees: 

I am pleased to be here today to discuss what is known about Head Start’s 
impact on children and their families. I also want to discuss the adequacy 
of the Department of Health and Human Services’ (hhs) current research 
plans to provide additional information on Head Start’s impact. 

For the past 30 years, Head Start has provided a comprehensive set of 
educational, health, mental health, and social services to low-income 
preschool children — an array of services generally not offered by other 
programs when Head Start began. Its ultimate goal is to improve the social 
competence of preschool children in low-income families. Head Start 
defines social competence as children’s everyday ability to deal with both 
their current environment and later responsibilities in school and life. » 
During these 30 years, the program has served over 15 million children at a 
total cost of more than $30 billion. Head Start’s funding has grown 
substantially in recent years, and further increases have been proposed. 
For example, between fiscal years 1990 and 1997, funding more than 
doubled — from $1.5 billion to almost $4 billion. The administration’s goal 
now is to expand the program’s annual enrollment to one million children 
by 2002. 

Although Head Start has long enjoyed both congressional and public 
support, opinions about the program’s impact have been divided. We 
define impact as differences in outcomes, such as improved school 
readiness or health status, caused by Head Start participation. Implicit in 
this definition is the concept that differences found would not have 
occurred without program participation. Conflicting information on 
program impact and the focus on results-oriented program performance 
information required by the Government Performance and Results Act 
(Results Act) of 1993 have renewed interest in the outcomes and impact of 
the current Head Start program. In response to this interest, in a 1997 
study, 1 we reviewed the research literature on Head Start to determine 
what was known about the impact of the current program. 

In my statement today, I will discuss the results of that research review, 
hhs’ current initiatives to assess program impact, and possible ways to 
improve hhs’ efforts. This discussion is based on our past work and our 
assessment of information from hhs about its new and planned initiatives, 
although we have not independently reviewed these initiatives. 



‘Head Start: Research Provides Little Information on Impact of Current Program (GAO/HEHS-97-59, 
Apr. 15, 1997). 
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In summary, the Head Start program has provided comprehensive services 
to millions of low-income children and their families — services that in the 
program’s early years participants probably would not have otherwise 
received. Little is known, however, about whether the program has 
achieved its goals. Although an extensive body of literature exists on Head 
Start, only a small part of that involves program impact research. Because 
of these research studies’ individual and collective limitations, this body of 
research is insufficient for use in drawing conclusions about the impact of 
the national program. 

hhs has the following initiatives it describes as impact assessments: 

(1) development of performance measures focusing on program outcomes, 
rather than just processes; (2) a national longitudinal study of a 
representative sample of Head Start children and their families (Family 
and Child Experiences Survey— faces); and (3) a collaborative effort with 
the National Center for Educational Statistics (nces). These efforts are 
headed in the right direction for Head Start to evaluate the impact of its 
program. It is unclear, however, whether these efforts will meaningfully 
compare the outcomes achieved by Head Start children and their families 
with those achieved by non-Head Start children and families, leaving 
unanswered q ues tions about Head Start’s impact. ' 



Background 



Since 1965, Head Start’s primary goal has been to improve the social 
competence of children in low-income families, that is, their everyday 
ability to deal with both their current environment and later 
responsibilities in school and life. This considers the relationships 
between cognitive and intellectual development, physical and mental 
health, nutritional needs, and other factors. Head Start delivers, or 
provides access to, a wide range of services — educational, medical, dental, 
nutrition, mental health, and social services, hhs administers the Head 
Start program through its Head Start Bureau within the Administration for 
Children and Families (acf). 

Public and private nonprofit agencies that receive their funding directly 
from hhs provide Head Start services at the local level. These agencies 
include public and private school systems, community action agencies, 
government agencies, and Indian tribes. In fiscal year 1996, about 1,400 
local agencies, called grantees, received Head Start grants. Grantees are 
required to obtain additional funding from nonfederal sources to cover 
20 percent of their program costs. Head Start grantees work with various 
community sources to provide services. For example, some grantees 
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coordinate with public health agencies to obtain health services, while 
others contract with local physicians. Although all grantees operate under 
one set of performance standards, they have a great deal of discretion in 
implementing those standards, resulting in programs that vary. 

In addition to providing services to children and families, Head Start sees 
one of its roles as a national laboratory for child development. 
Consequently, Head Start uses much of its discretionary research funding 
for demonstrations and studies of program innovations. The amount of 
funds allocated to research, demonstration, and evaluation has 
represented about 2 percent of the Head Start budget over the years. 

About $12 million (about 0.3 percent of the Head Start budget) was so 
allocated for fiscal year 1997. 

The main focus of the program’s research, according to Head Start Bureau 
officials, has been to improve the program by exploring ways to maximize 
and sustain Head Start benefits. In addition, Head Start funds studies 
designed to answer questions on the effectiveness of new or innovative 
service delivery strategies. Such studies typically involve special program 
efforts and demonstration projects conducted on a trial basis at a few 
Head Start sites that focus on practices or services not typically found in 
regular Head Start programs. 2 

The passage of the Results Act in 1993 has heightened the importance of 
the type and direction of this research. The Results Act is designed to hold 
federal agencies accountable for achieving program results. The act 
specifically requires that agencies clearly define their missions, establish 
long-term strategic goals as well as annual goals linked to them, measure 
their performance according to their performance goals, and report on 
their progress. Agencies are also expected to perform discrete program 
evaluations and to use information from these evaluations to improve their 
programs. 

The Results Act encourages a focus on delineating desired outcomes and 
developing performance measures to assess achievement of those 
outcomes. In addition, the Results Act focuses on objective and systematic 
assessments of the manner and extent to which programs achieve their 
intended objectives. In assessing outcomes, we are referring to achieving 
program purposes, such as promoting child wellness. As noted, we define 



2 The term “regular” Head Start refers in this testimony to programs that operate within the scope of 
established Head Start program options and under normal Head Start requirements. Regular programs 
are to be distinguished from demonstrations and other special programs that serve populations or 
offer services not normally found in Head Start 
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